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ABSTRACT 



This paper outlines a framework for the study of innovation that treats discoveries as additions to 
evolving networks. As inventions enter they expand or limit the reach of the ideas they build on by 
influencing how successive discoveries use those ideas. The approach is grounded in novel measures 
of the extent to which an innovation amplifies or disrupts the status quo. Those measures index 
the effects inventions have on subsequent uses of prior discoveries. In so doing, they characterize 
a theoretically important but elusive feature of innovation. We validate our approach by showing 
it: (1) discriminates among innovations of similar impact in analyses of U.S. patents; (2) identifies 
discoveries that amplify and disrupt technology streams in select case studies; (3) implies disruptive 
patents decrease the use of their predecessors by 60% in difference-in-differences estimation; and, 
(4) yields novel findings in analyses of patenting at 110 U.S. universities. 
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Economic progress, in capitalist society, means turmoil. . . New products and new methods compete 
with the old products and old methods not on equal terms but at a decisive advantage that may 
mean death to the latter. — Schumpeter (1942: 32) 

1 INTRODUCTION 

Innovation and its implications are near ubiquitous components of social scientific explanations 
for stability and change. Yet, existing conceptual and empirical tools are often ill equipped to 
address the process by which new discoveries ripple through social, economic, and technological 
systems to reinforce or destabilize the status quo. Despite 70 years of work to develop Schumpeter's 
(1942) notion of creative destruction, clear and systematic explanations for why, when, and how 
particular inventions have differential effects on their environments remain elusive. This paper 
develops a conceptual vocabulary and associated measures to address that important lacuna. 

We argue that a discovery's effects can be read neither from its characteristics at the time 
of its creation nor from the magnitude of its later use. Both ideas are important, but miss the 
crucial point that innovations have effects that unfold over time in environments at least partially 
comprised of other discoveries. The effects inventions have on subsequent uses of other knowledge 
are thus essential. 

This notion is aligned with but underutilized in contemporary social scientific work, most of 
which builds on two core theoretical insights about the dynamics of innovation. First, innovation 
is a process of recombination (Hargadon & Sutton, 1997; Fleming, 2001). New technologies, even 
breakthroughs, are seldom cut from whole cloth; most emerge as previously existing components are 
arranged into new configurations. Second, technological development is a path dependent process 
punctuated by periods of discontinuous change (Teece, 1986; Dosi, 1988; Sosa, 2009). Innovations 
create skills and capabilities that enable the development of more incremental new products and 
processes. Consequently, important innovations become widely used until they too are rendered 
obsolete by subsequent breakthroughs, whose own trajectory of use follows a similar pattern. 

These perspectives have proven valuable but each is hampered by limitations. The idea of 
innovation as recombination, for instance, is theoretically ambiguous. Some new configurations are 
useful but many are worthless, and there exist few means to distinguish between the two a priori. 
Moreover, studies that foreground recombination have difficulty accounting for dynamics because 
the particular set of components that constitute a discovery are largely fixed at the time of its 
introduction. Theories that focus on discontinuities in use are better able to account for dynamics, 
but their emphasis on the magnitude of use — the impact — of a discovery misses the key substantive 
distinction between new things that are important because they reinforce the status quo and new 
things that are valuable precisely because they challenge the existing order. 

Closely tied to these theoretical limitations are issues of measurement. Most empirical measures 
fall into one of two classes according to the properties they use to evaluate innovations. One 
class seeks to capture distinctiveness — the extent to which an innovation departs from existing 
knowledge. Researchers often measure distinctiveness by, for instance, identifying patents that 
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bridge previously disconnected technological classifications (Trajtenberg et al., 1997; Fleming, 2001; 
Gruber et al., 2012). 

Like the concept of recombination itself, measmres of distinctiveness are limited because they 
evaluate an innovation at its point of introduction, and neglect the extent and nature of its sub- 
sequent use. In so doing, distinctiveness measures miss the possibility that an innovation's true 
utility unfolds over time in the context of use, organizational strategies, market changes, and the 
evolution of fields (Bijker, 1995; Rao, 2009). The possibility that a discovery might languish until 
conditions are right for its recognition and adoption — and the likelihood that such conditions might 
result from strategic efforts of inventors and organizations — cannot be addressed by measures that 
emphasize a discovery's features at its conception. 

Another class of measures treats discoveries as variable in impact — the extent to which they are 
later used. Technological discontinuities tend to be high impact because they serve as platforms that 
stimulate future discoveries, but some high impact innovations are important because they advance 
an ongoing, vibrant technological trajectory. Although the true impact of an innovation is difficult 
to measure, citations to papers and patents that report new findings and inventions offer a widely 
used proxy (Hall et al., 2002). But by measuring only magnitude of use, impact measures miss 
how a technology is used. Consequently, they obscure the key difference between innovations that 
amplify the use of existing ideas and those that disrupt them. This ambiguity makes substantive 
analysis of the social and economic consequences of significant discoveries challenging. 

We conceptualize innovations as additions to preexisting networks of complementary or sub- 
stitutable components. New discoveries alter a network's evolving structure by changing the way 
subsequent additions connect. These networks, and the fields they represent, change as new en- 
trants diminish or enhance the visibility of incumbents (Powell et al., 2005). Although our focus 
here is on networks of interdependent technological inventions, the framework we develop could be 
applied to any system of related physical or conceptual components that grows over time by the 
addition of nodes and directed links. 

Our approach builds on theories that distinguish between innovations that are competency 
destroying, in that they render existing skills obsolete, and those that are competency enhancing, 
in that they improve the productivity or value of existing capabilities (Abernathy & Clark, 1985; 
Tushman &: Anderson, 1986; Sosa et al., 2012). We depart from this prior work in several ways, 
however. First, like much research on innovation, existing studies of competency-enhancing and 
competency-destroying discoveries tend to emphasize substantial discontinuities that fundamentally 
break with existing standards. By contrast, we suggest that the extent to which an innovation 
influences the status quo is a matter of degree, not categorical difference. Second, our approach 
decouples the amplifying or disrupting effects of new discoveries from the concrete competencies 
of the organizations that develop and own them. Although the implications of new discoveries are 
often felt most forcefully in terms of how they influence the value of incumbents' capabilities, their 
effects ripple through dynamic networks of prior and subsequent discoveries. 

To capture this network model of innovation, we develop a relational measure, disruptiveness, 
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that quantifies the extent to which an invention amplifies or diminishes subsequent use of the 
components on which it builds. Combining our index of disruptiveness with an impact weight 
yields a new operationalization of radicalness. These measures are sensitive to both the positive 
and negative effects of important discoveries. 

We begin by reviewing current approaches to technological change in order to identify core 
properties of breakthroughs and delineate the scope of our contribution. Next, we derive our 
measures of disruptiveness and radicalness. Subsequent sections validate those measures in three 
ways. First, we demonstrate that disruptiveness discriminates among inventions of similar impact 
by applying the measure to U.S. patents issued between 1976 and 2010. Second, we present short 
case studies of three high-profile inventions that illustrate core features of disruptiveness and rad- 
icalness while attesting to the measures' ability to identify recognized breakthroughs. Finally, we 
cement claims to validity using difference-in-differences estimation, which shows that patents cited 
by highly disruptive innovations see a 60% decline in citations after the disruptive patent issues. 

We establish the usefulness of our approach in inferential analyses of the impact, distinctiveness, 
and radicalness of 55,322 patents assigned to the 110 most research-intensive U.S. universities 
between 1976 and 2005. Analyzing the radicalness of these patent portfolios yields novel and 
substantively important results relative to analyses of impact or distinctiveness. We replicate 
existing findings about the impact of university patent portfolios that demonstrate diminishing 
returns to commercial experience and positive effects of increases in R&D sponsorship from both 
industrial and federal government sources. Models of radicalness, however, manifest starkly different 
effects, showing that higher levels of industrial support result in the production of less radically 
disruptive patents on campus. Federal R&D support, by contrast yields more radically disruptive 
discoveries. 

2 THEORY AND MEASURE— THE EFFECTS OF INNOVATIONS 
2.1 Properties of Breakthroughs 

Schumpeter distinguished between innovation and invention by emphasizing the impact of discov- 
eries. Innovations are ideas that spark economic transformations by introducing new materials, 
technologies, or production processes. Inventions are isolated discoveries that have few social or 
economic effects (Schumpeter, 1942: 132). Although precise terminology can be inconsistent from 
author to author, there is wide recognition that a core dimension along which innovations vary is in 
their degree of use (Hall & Trajtenberg, 2004; Lanjouw Sz Schankerman, 2004). These observations 
suggest a first property of breakthroughs: 

Property 1 A breakthrough discovery is high impact when it is widely used 

Impact is used both conceptually and as family of measures for evaluating innovations. Counts 

of citations to articles and books have served for decades as proxies for use and scientific quality 
(Price, 1965). Metrics like impact factor and the /i-indcx also quantify use, but for aggregated sets 
of documents (Hirsch, 2005). Moreover, virtually all studies of diffusion rely on some notion of 
use or imitation to account for the spread of information, practices, and products (Griliches, 1957; 
Angst et al., 2010; Greve, 2011). 
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Discoveries also vary with respect to how much they differ from their predecessors. Techno- 
logical developments are seldom completely new but rather consist "to a substantial extent of a 
recombination of conceptual and physical materials that were previously in existence" (Nelson & 
Winter, 1982: 130). Important discoveries often involve the unique combination of disparate mate- 
rials or the rearrangement of previous combinations using novel relationships (Henderson & Clark, 
1990). For example, Hargadon (2002) describes how engineers at Design Continuum combined 
Reebok's athletic shoe designs with inflatable splints and IV bag technology from the medical de- 
vice industry to create the Reebok Pump shoe. By contrast, more routine discoveries typically 
involve slight variations of extant combinations. These observations suggest a second commonly 
identified property of breakthroughs: 

Property 2 A breakthrough discovery is distinctive when it recombines existing components in new ways 

Recombination occurs at the time of discovery. Consequently, distinctiveness has been empha- 
sized by researchers who study the innovation process (Burt, 2004; Aral & Van Alstyne, 2011). For 
example, Evans (2010) finds that firms' indifference to theory — but generous financial support — 
leads academic collaborators to produce more papers with more distinctive combinations of biolog- 
ical terms. Fleming and colleagues (2007) find that collaborations between previously disconnected 
inventors generate distinctive patents that span rarely combined technology classes. 

Both impact and distinctiveness fail to capture core dynamics of innovation. Impact differ- 
entiates among discoveries based on the extent of their use but says little about how they relate 
to prior technologies. Distinctiveness discriminates between more unique and more conventional 
discoveries based on how they relate to prior technologies, but offers little information about the 
extent of a given technology's future use. The measures are helpful for assessing the value of an 
innovation (impact) or examining the products of different discovery processes (distinctiveness). 
Nevertheless, capturing an innovation's implications for economic growth and technological change 
requires attending to the effects they have on the use of existing technologies. Based on these 
observations, we propose the following properties. 

Property 3a A breakthrough discovery is amplifying when it increases the rate at which future innovations use 

the components on which it built 

Property 3b A breakthrough discovery is disrupting when it decreases the rate at which future innovations use 
the components on which it built 

Properties 3a and 3b relate to the notions of competency-enhancing and competency-destroying 

discontinuities (Tushman Sz Anderson, 1986), but differ in important respects. First, amplification 

and disruptiveness capture patterns of component use. This generality is attractive because it allows 

application to a broad range of phenomenon related to innovation. However, the implications of the 

waxing or waning use of particular technologies for the value of firm competencies is an empirical 

question that we expect to vary from context to context. Second, amplification and disruptiveness, 

unlike competency enhancement or destruction, are continuous properties whose value can change 

over time. For example, discoveries that are disrupting may be only modestly so; and, their effects 

may vary in strength. By contrast, the notion of a competency- destroying discovery implies a 

categorical and permanent break with a previous state of affairs. 
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2.2 Measuring the Effects of Innovations 

A dynamic network measure of the importance of a new discovery should have four features. First, it 
should be structural in a network sense. Properties 3a and 3b suggest the measure should integrate 
the degree to which future inventions that build on a discovery also rely on its predecessors. This 
'second order' form of impact suggests that the importance of an innovation lies more in how 
it effects the use of other technologies rather than directly in its own use. Second, the measure 
should be dynamic — able to account for variations across the life of a discovery. Our measure of 
disruptiveness identifies the extent to which a discovery changes the use of its predecessors over time. 
While distinctiveness stays fixed, disruptiveness can shift with changes in science and technology, 
regulation, markets, and other features of the larger environment. Third, the measure must be 
continuous — able to capture degrees of amplification and disruptiveness. Continuous measures will 
prove useful for both analyses of large-scale, radical transformations and smaller-scale, incremental 
shifts that occur at the level of individuals or organizational routines (Feldman &: Pentland, 2003). 
Finally, the measure should be valenced — able to distinguish between disrupting and amplifying 
innovations. A valenced measure discriminates among innovations with similar distinctiveness and 
impact, but very different consequences for the status quo. 

We develop and test a measure with these characteristics using U.S. utility patents. Utility 
patents cover the majority of patented inventions; they include any new (or improved) method, 
process, machine, manufactured item, or chemical compound. Although other types of patents 
exist, most patents granted in the U.S. fall in the utility category — over 90% in 1999 (Hall et al., 
2002). To avoid complexities arising from differences in citation practices across categories, we 
limit our analysis to utility patents. 

Patent data are valuable for our purposes because they have been used extensively, which 
facilitates comparisons between our results and existing findings. Studies show that a patent's 
citation impact is correlated with its social and economic value (Hall et al., 2005; Harhoff et al., 
1999). Patent data are also attractive methodologically. Before being granted, all patents must pass 
through an evaluation process. Examiners review prior art citations with an eye toward ensuring 
comprehensiveness. Applicants have relatively strong incentives to ensure citation accuracy. Listing 
irrelevant prior art weakens a patent's enforceability, while failing to acknowledge related work can 
render a patent invalid. In short, patent citations provide a convenient and generally reliable record 
of the prior technology upon which a patented innovation builds 

Mathematically, we define disruptiveness as foUowsj^ Consider a tripartite graph G = {Vi, V2, V3, E), 
where Vi, V2, and V3 represent three classes of nodes and E denotes the edges in G. Nodes are 

^Nevertheless, patent data are known to have hmitations. For example, inventors may not seek patent protection for 
their ideas. Moreover, the process of patent examination has received criticism from observers who argue that the 
USPTO grants many patents that fail to meet the requirements of novelty and non-obviousness (Jaffe & Lerner, 2004; 
Lemley & Sampat, 2008). We suspect most poor quality patents will score close to zero on our measures, though 
this remains a matter for empirical testing. For a more complete discussion of the advantages and disadvantages of 
patent data, see Griliches (1990) and Jaffe et al., (2002). 

^Should this paper appear in print, we will make a patent-based implementation of these measures and accompanying 
C-|— I- code publicly available. 
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only connected if they belong to different classes. Let Vi consist of a focal patent, /, V2 consist a 
set of prior art, b, cited by the focal patent, and V3 consist of a set of forward citations, i. Classes 
/ and b are fixed at focal patent's issue date, but i can grow as time passes and the patent accrues 
new citations. Our objective is to model how a new patent, i, attaches to the network defined by 
the ties (citations) between patents of class b and /. Attachment takes place in one of three ways: 
(1) i can cite the focal patent prior art (class b), (2) i can cite the focal patent (class /), or (3) 
i can cite the focal patent and its prior art (both class / and b). For a focal patent and vector 
i = (ii,i2, ■ ■ ■ ,*n-i;^n) of forward citations to that patent and/or its prior art at time t, we define 
disruptiveness as 

jj^ ^ Zli {-'^fitbit + fit) 
* nt 



where 



and 



if i cites the focal patent (class /) 
otherwise. 



if i cites any focal patent prior art (class b) 
otherwise. 



Here, n is the number of forward cites in i. The measure ranges from -1 to 1, with positive values 
representing innovations that are more disrupting and negative values highlighting innovations 
that are more amplifying. Thus, despite the name 'disruptiveness,' both disrupting and amplifying 
innovations are identified. Note that the measure can be readily calculated for both high- and low- 
impact patents, i.e., patents that receive very many and very few forward citations, respectively. 
The measure distinguishes impact from disruptiveness using a structural approach that is sensitive 
to the addition of new citations to the network]^ It is not defined for patents that do not cite 
any prior art and that do not receive any subsequent citations by future patents. In network 
terminology, these patents are isolates, disconnected from other actors in the system. We set the 
disruptiveness score of these patents to zero, as they have neither impact nor influence over the use 
of existing innovations. 

Finally, the magnitude of a focal innovation's future use can be added to the measure by 
introducing a weighting parameter to Equation 1 and eliminating the normalization by rit- Given 
a weight vector w = {101,102, ■ ■ ■ , Wn-i, Wn), 

Rt = y[ ] ,wit>0 4 

i\ Wit J 

where Wi is the weight given to patent i. For simplicity, we set wa equal to 1 so that each i 
contributes equally]^ We call this measure 'radicalness' to indicate the combination of disruptiveness 

^For the exploratory empirical analyses presented in this paper, we set t — 2010. 

"'a more dynamic (but also complex) approach could, for example, determine the values of w according to the issue 
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and impact. The measure differs from disruptiveness by distinguishing among innovations according 
to their overall effect on a network of interlinked technologies. Disruptiveness captures the direction 
of an innovation's effects, while radicalness mixes both direction and magnitudej^ 

Radicalness meets the criteria laid out in section 2.1 above. Specifically, it captures impact 
through a forward citation weight, characterizes disruptiveness on a continuous scale by measuring 
interrupted citation flows, discriminates between both disrupting (positive disruptiveness) and am- 
plifying (negative disruptiveness) inventions, and its value can vary dynamically as new inventions 
enter the network. 

3 DISRUPTIVENESS DISCRIMINATES AMONG HIGH IMPACT PATENTS 
3.1 Data and Methods 

We test our measure's ability to discriminate among patents of similar impact using a sample that 
consists of the 9,747 U.S. patents granted between 1976 and 2010 that were cited more than 142 
times. During this period, 3,983,089 patents were issued. Thus our dataset represents the top 0.25% 
of patents by impact. The basic data were obtained from the Patent Network Dataverse (Lai et al., 
2011) and supplemented with data taken from the USPTO. Because all of the top 0.25% patents 
are high impact by definition, we calculate the normalized (un-weighted) disruptiveness measure 
for each. We also report some population-level statistics for all patents granted during the study 
window to ensure that our conclusions are not driven by the unique properties of this samplej^ 

The disruptiveness scores of both the top 0.25% sample and population are unimodal with 
modes of 0, means of 0.09, and roughly approximate a normal distribution. A moderately thicker 
right hand tail in the top 0.25% sample suggests that more high impact patents disrupt than amplify 
the use of their predecessors. Far more patents from the full population have disruptiveness scores 
near 0. The modal patent has little effect on the use of prior technologies. Both distributions lean 
slightly to the right, which suggests that modestly disrupting innovations may be more common 
than slightly amplifying onesj^ 

Table 1 displays descriptive statistics and correlations for the top 0.25% patents. The table 
clearly suggests that our measure functions as intended. The (small) negative correlation between 
disruptiveness and firm assignee (r = —0.01, p < 0.05) suggests that firms tend to produce more 



date of i such that older citations have greater or lesser influence over the measure. Further, w might be weighted 
according to the distinctiveness of i in order to emphasize the fleld enhancing or field opening character of a discovery. 

^Our decision to focus on classes of nodes and binary relations them results in the loss of some structural data. We 
address these issues more fully in the Appendix. 

®While our approach is conceptually straightforward it can be computationally demanding. For example, there are 
269,663,060 pathways connecting the prior art of the top 0.25% patents and their forward citations and more than 
100 billion when we consider the full population. Given the scale of the data and complexity of the networks, we 
made use of a high performance distributed computing environment provided by our home institution to complete 
these calculations. 

''Prior research indicates that disruptive innovations are rare and therefore is contrary to the control sample distri- 
bution, but much existing literature fails to account for the possibility that disruptiveness is a matter of degree. 
When interpreting the distribution, it is useful to keep in mind that the disruptiveness measure is only modestly 
correlated with impact (r = 0.05, p < 0.001) and expressed on a continuous scale. Given that patents are somewhat 
costly to obtain and that applicants are legally required to demonstrate how their invention is non-obvious, useful, 
and novel, this slight distributional skew may be expected. 
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amplifying innovations, whereas universities (r = 0.05, p < 0.001) and government laboratories 
(r = 0.06, p < 0.001) generate more disruptive breakthroughs]^ These correlations are sensible, 
as companies tend to specialize in application-oriented development while public sector research 
organizations often emphasize more basic research (Dasgupta & David, 1994). 

Insert Table 1 about here 

Disruptiveness is also positively correlated with acknowledgement of a 'government interest' 
(r = 0.05, p < 0.001). Government interest patents typically result from federally funded research 
programs that have been vetted by peer review and are often oriented toward more fundamental 
discoveries. Finally, the small positive correlation between team size and disruptiveness (r = 
0.02, p < 0.05) implies that larger teams may produce more disruptive innovations, a potentially 
noteworthy addition to research on collaborative, team science (Wuchty et al., 2007; Singh &: 
Fleming, 2010). 

Insert Figure 1 about here 

Figure 1 shows the within year variability of patent disruptiveness for the full population. 
Consistent with critiques about the exploding volume of patenting activity and perceived lowering 
of quality thresholds required for obtaining a successful grant, the figure suggests that the average 
high impact patent of today tends to be notably less disrupting than those of the late 1970s and 
early 1980s (Jaffe &: Lerner, 2004). At the same time, more outliers score disproportionally high 
on the continuum of amplifying to disrupting innovation in later years. These observations also 
manifest in negative correlations between disruptiveness, application (r = —0.21, p < 0.001), and 
grant year (r = —0.21, p < 0.001) among the top 0.25%. Also of note are the small associations 
between impact, application (r = —0.07, p < 0.001), and grant year (r = -0.06, p < 0.001)0 
3.2 Qualitative Assessments of Validity 

Quantitative descriptions of disruptiveness suggest the measure is consistent with established find- 
ings about the correlates and features of various types of innovations. But how well is it able 
to identify and classify particular breakthroughs? Table 2 reports values for the components of 
disruptiveness and the measure itself for select discoveries that have exerted significant effects on 
their respective industries. 

Insert Table 2 about here 

Several of the most amplifying innovations are enhancements in oil and gas drilling technologies. 
These patents are all assigned to large petroleum companies — the incumbents in an industry with 
high entry barriers (Orr, 1974). These discoveries do not establish new methods; rather, they 

^Because few patents are assigned to more than one organization (0.59% in the sample) we only show results for the 
first assignee. 

^In unreported comparisons, we found few substantial differences in the distribution of disruptiveness across broad 
(NBER) technology categories. Computers and Communications patents (including software), however, appear to 
do relatively less to either amplify or disrupt than do other classes. 
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refine already widely used technologies. For example, patent 4,573,530, "In-Situ Gasification of Tar 
Sands Utilizing a Combustible Gas," assigned to Mobile Oil Corporation, describes an improved 
process for extracting carbon monoxide and hydrogen from tar sands. Such process innovations 
have become important in recent years because conventional gasification methods are difficult to 
use in remote regions like Northern Alberta, Canada, where the largest tar sands deposits are 
located. 

The measure also effectively identifies known disruptive innovations. Patents 4,237,224, 4,399,216, 
and 4,683,202, the Cohen-Boyer patent on recombinant DNA, the Axel patent on the eukaryotic 
cotransformation, and the Mullis patent on polymerase chain reaction (PGR) appear at the bottom 



of Table 2 These three discoveries from the late 1970s and early 1980s set the stage for the molec- 
ular biology revolution in pharmaceutical R&D by making techniques for targeted in vitro drug 
discovery possible (Powell &: Owen-Smith, 1998). That technological shift fundamentally altered 
the structure of the international pharmaceutical industry in the 1980s and 1990s by challenging 
more traditional, organic chemistry based drug discovery methods (Henderson & Cockburn, 1996; 
Powell et al., 1996). These process patents were also exceptionally lucrative for their assignees. 
The Cohen-Boyer patent generated some $255 million in licensing royalties for Stanford University 
over its lifetime (Hughes, 2001). A more aggressive licensing policy at Columbia University led 
the Axel patent to yield some $790 million in revenues (Colaianni &: Cook-Deegan, 2009). Finally, 
some estimates place the total royalties for the Mullis patent at $2 billion (Fore et al., 2006). 

The scanning tunneling microscope (STM, patent 4,334,993) and the atomic force microscope 
(AFM, patent 4,724,318) together enabled the development of nanotechnology (Darby & Zucker, 
2003; Mody, 2011). Both instruments image and move individual atoms on the surface of a material, 
which allows electronics, medications, and other products to be designed and built atom-by-atom. 
While both discoveries are disruptive, the AFM is less so than the STM. This relative ranking 
accords nicely with the technological history of nanotechnology. Although the STM was introduced 
five years before the AFM, the AFM offered several major improvements, including 3-dimensional 
renderings and the ability to image living organisms (Youtie et al., 2008). Although the AFM 
was a radical improvement over prior generations of microscopes, it was ultimately less disruptive 
because it built on (and cited) the more transformative STM. 

Finally, consider patent 5,016,107, for an "Electronic Still Camera Utilizing Image Compression 
and Digital Storage." This is an Eastman Kodak patent for an early digital camera that employed 
novel techniques for image processing, compression, and recording on a removable storage medium 
(Gavetti et al., 2004; Lucas & Goh, 2009)0 

^'^By convention, we refer to these patents using the last names of their authors. The inventors' full names are, 
respectively, Stanley N. Cohen and Herbert W. Boyer, Richard Axel (with Michael H. Wigler and Saul J. Silverstein) 
and Kary B. Mulhs. 

^^Note that relative to the perceived disruptiveness of digital photography for silver halide imaging, this patent ranks 
relatively low on the disruptiveness index with a score of 0.14. One explanation for this is that unlike some of the 
other technologies discussed above, a single patent did not cover the advent of digital photography (Christensen, 
1997; Gavetti et al., 2004). In Appendix A, we present a generalization of the disruptiveness measure that may 
prove useful for estimating the effects such patent families have on the technologies that precede them. 
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The examples described above cover breakthrough innovations from a wide array of industries 
and technology classes. They demonstrate that our framework distinguishes between disrupting 
and amplifying innovations, as well as among degrees within each category. 

We now turn to a more detailed consideration of three innovations — glyphosate resistant soy- 
beans, a method of ranking of online search results, and a eukaryotic cotransformation technique — 
that represent different locations on the amplifying-disrupting spectrum. We chose widely studied 
breakthroughs to emphasize our measure's utility for the analysis of radically amplifying, moder- 
ately disruptive, and radically disruptive inventions. Our focus on innovations drawn from three 
disparate technology intensive sectors (agriculture, information technology, and biotechnology) also 
suggest that this approach can inform organizational research across a broad range of fields. 

Insert Figure 2 about here 

Consider Monsanto's patent 6,958,436, entitled "Soybean Variety SE90346." This invention 
clearly illustrates the core premise of an amplifying discovery. The patent describes a genetically 
engineered soybean that is resistant to glyphosate, an herbicide patented by Monsanto in the 
1970s. Glyphosate is the active ingredient in Monsanto's Roundup product line, the number one 
selling herbicide worldwide. In addition to glyphosate tolerance, the seed integrates other desirable 
plant traits — like improved yield, immunity to various diseases, and resistance to shattering — 
using many genetic sequences owned in full or in part by Monsanto. Genetically engineered seeds 
amplify the value of the earlier patented chemical and biological innovations by broadening potential 
application areas and excluding competitors (Graff et al., 2003; Pollack, 2009). In this particular 
case, Monsanto has developed a plant variety specifically engineered to resist damage from its 
market-leading herbicide (Brennan et al., 2000). 

The top panel of Figure 2 plots the network of citations between the Monsanto soybean patent, 
its prior art, and subsequent inventions that have made use of them. The line graph below the figure 
tracks the patent's annually updated disruptiveness. In the network diagram, as in the measure, 
forward citations are divided into three types. Triangles are patents that cite the focal patent's 
prior art, but not the focal patent itself. Circles represent patents that cite only the focal discovery 
and not its prior art. Finally, squares indicate patents that cite both the focal patent and its prior 
art. 

The figure suggests interesting features of this radically amplifying discovery. Notice that al- 
though the soybean patent has received 150 total citations, it has never been cited independently of 
its prior art. The patent's introduction also virtually eliminated independent citations to its prior 
art (i.e., triangles). The line graph tracking its disruptiveness starts at zero but declines rapidly to 
approach -1. This pattern implies that the focal patent and the technologies on which it builds are 
complementary in a way that would not be expected if this discovery had, for instance, opened a 
new method of plant engineering. 

Although not directly revealed in the figure, two additional features of the Monsanto soybean 
patent are suggestive. First, consider raw citation counts. In the five years before the focal patent 
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was granted, the five pieces of prior art received a total of 61 citations, or 2.44 citations per patent 
per year on average. In the five years immediately following the soybean patent grant, citations to 
the prior art increased by more than 600%, to an average of 15.28 per patent per year 
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Second, consider the ownership of the antecedent technologies. By the time of application, 
Monsanto had acquired the firms that owned all but one of the five pieces of prior art cited by 



the focal patent This observation fits well with theories of technological innovation that argue 
incumbent firms strive to enhance the value of their knowledge bases (Sosa, 2011). It also suggests 
interesting possibilities for using this approach to examine corporate decisions about when to lit- 
igate competitor's intellectual property (Allison & Lemley, 1998; Allison et al., 2004). We would 
predict, for instance, that the most likely patents to be challenged in established industries are 
those that amplify the technological position of a significant competitor. A similar logic might be 
used in explanations of merger and acquisition activities in technologically intensive fields, where 
complementary patent portfolios often loom large. 

Next, we examine the modestly disruptive patent 6,285,999, entitled "Method for Node Ranking 
in a Linked Database." This invention, more commonly referred to as PageRank, covers the core 
algorithm used by Google to weight the importance of web pages for display in its search results. 
Prior to the introduction of PageRank, search engines used a variety of largely ineffective strategies 
to rank search results (Brin & Page, 1998). PageRank, which is owned by Stanford University but 
licensed exclusively to Google, proposed an entirely new method that drew on insights from social 
network theory to rank web pages by the number of links they receive from other sites. PageRank's 
disrupting effects are evident in Yahoo! 's June 2000 agreement to outsource its search function to 
Google. Prior to the implementation of Google's search technology, Yahoo! was the market leading 
search engine. After the introduction of this disruptive innovation, Yahoo! could only maintain its 
position by adopting its competitor's technology. 

The middle panel of Figure 2 presents the network of citations involving the PageRank patent, 
its prior art, and subsequent patents that made use of either. The figure is particularly instructive 
in comparison to the pattern of citations for the Monsanto soybean patent above it. Unlike the 
soybean patent, which quickly garnered a substantial number of citations, PageRank appears to 
have been overlooked in years immediately following its 2001 publication Most citations between 
2002 and 2007 cite PageRank's prior art, but not the patent itself. This pattern begins to change 
between 2007 and 2010, when many more subsequent discoveries cite only the PageRank patent 
without citing its prior art. It is during this latter period that the PageRank patent began to 
appear increasingly disruptive to the use of its predecessor technologies. This pattern of change is 



^^Of course, this calculation does not account for possible right truncation due to delays between patent application 
and grant years, and may also be inflated due to increases in the frequency of patenting and citation over time. 
Below, we present models that control for these and other factors. The results are broadly similar. 

i^Patent 5,084,082 is owned by DuPont. 

^*The PageRank patent also differs from the Monsanto case in that its backward citations come from a more diverse 
base of organizations, as would be anticipated for a more disrupting discovery. The seven pieces of prior art cited 
by the patent are owned by a total of four different corporations and one university, none of which are Stanford or 
Google. 
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also evidenced in the disruptiveness teendline, which begins near zero and rises fairly smoothly to 
a high of 0.37. 

We suspect that the eventual effect of PageRank had as much to do with Stanford's decision 
about how to license the patent, with the 'build fast and monetize later' strategy of growth char- 
acteristic of Google's high profile venture capitalists, and with the evolution of the company itself, 
as it did with technical features of the discovery (Levy, 2011). In other words, this technology's 
substantial effects may depend intimately on the strategic and tactical decisions of organizations 
that owned, funded, and developed it. A time-varying version of disruptiveness, such as that illus- 
trated in Figure 2's trend lines, may thus prove useful for theory and analysis of the co-evolution 
of technologies, industries, and organizations (Murmann, 2003). 

For our final case, we turn to the Axel patent on eukaryotic cotransformation, in the bottom 
panel of Figure 2. This extremely disruptive discovery is one of the foundational innovations for 
biotechnology. In contrast to both Monsanto's soybean and Google's PageRank, citations to the 
prior art cited by Columbia's Axel patent effectively cease within two years following its publication. 
Out of nearly 340 citations to the Axel patent, only one subsequent invention has cited the discovery 
together with its prior art and only 14 cited the predecessor technologies on their ownj^ Indeed, 
the trend line below this panel suggests that a radical change in disruptiveness happened three 
years after issue, and was followed by a smooth rise to a maximum value of 0.95. 

The juxtaposition of the cotransformation and soybean patents is interesting when viewed in 
light of research on technology paradigms and industry life cycles (Dosi, 1988; Klepper, 1997). If 
the Axel discovery and similar radically disruptive innovations laid the foundations for molecular 
biology in the late 1970s and early 1980s, then subsequent breakthroughs that follow much later 
but operate within the same paradigm should be more amplifying (and possibly competency en- 
hancing) in nature, as is the case with the Monsanto patent. In other words, tracing changes in 
the disruptiveness of innovations belonging to particular 'lineages' over time might offer new means 
to evaluate industry evolution and the process by which knowledge paradigms and technology 
standards coalesce, expand, and are eventually swept away. 

4 VALIDITY AND USEFULNESS IN ANALYSES OF UNIVERSITY PATENTING 

The preceding descriptive and qualitative analyses suggest the dynamic network framework and 
associated measures of disruptiveness and radicalness we propose have a high degree of face validity 
and effectively distinguish among similarly high impact innovations that have disparate effects on 
their fields. This section examines the population of 55,322 U.S. utility patents issued from 1976- 
2010 to the 110 most research-intensive American universities. These campuses include every 
institution that has ever ranked among the top 100 nationally by federal obligations for science 

^^One important question is whether or not the Axel patent's high disruptiveness score of 0.95 could stem from the fact 
that it only cited two pieces of prior art. Put differently, if the patent had cited more predecessor technologies, would 
the score be lower? Among the top 0.25% patents, there is a modest negative correlation (r = —0.20, p < 0.001) 
between the number of backward citations made and a patent's disruptiveness. However, some association between 
the amount of prior art cited and disruptiveness should be anticipated. By definition, radically new innovations 
should have fewer predecessors available on which to build. 
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and engineering research. The dataset covers a broad set of high and low impact innovations and 
therefore serves as a useful setting in which to test the value of our approach for substantive analysis 
at the patent and the organizational levels. 

After describing our academic patenting dataset, wc use diffcrcncc-in-diffcrences estimation 
to examine the effect disruptive patents have on rates of citation to their prior art. Next, we 
turn to a university-level analysis of the organizational sources of important academic patents. 
Research on this topic to date has yielded mixed results. We believe the ambiguity in this line of 
work stems from a reliance on impact measures of innovative importance. Here, we demonstrate 
that analyzing campus-level sources of more radical patent portfolios offers clear insights into the 
dynamics of academic patenting that are less apparent in examinations of patent volume, impact, 
or distinctiveness. 

4.1 Descriptive Statistics and Correlations: Academic Patents 

Table 3 presents descriptive statistics and correlations at the university level for variables that will 
be used in our inferential analyses. 

Insert Table 3 about here 

The average disruptiveness for academic patent portfolios is 0.10, virtually the same as the 
average (0.09) reported in Table 1 for both the top 0.25% sample and the population of utility 
patents. The standard deviations are very different across the university and high impact samples, 
however (0.11 and 0.31 respectively). Although most patents are slightly disrupting, when we do 
not sample on impact, a much larger proportion cluster near zero. 

Academic patents also exhibit somewhat different patterns of correlation among the measures 
of importance. Notably, disruptiveness is more correlated with impact for academic inventions. At 
0.16 {p < 0.001), however, the association remains relatively slight. Impact is more strongly corre- 
lated with university level patent volume (r = 0.67, p < 0.001). Increasing patent impact may be in 
part a game of numbers. Disruptiveness exhibits a minimal, non-significant association (r = —0.03) 
with patent volume, suggesting again that our framework addresses features of innovation that are 
orthogonal to commonly used approaches. Correlations between disruptiveness and measures of 
university experience with technology transfer, engagement with industry, volume and impact of 
scientific articles, and federal (National Science Foundation [NSF] as well as National Institute of 
Health [NIH]) funding are also low, with none rising above 0.13. 

4.2 Difference-in-DifFerences Tests at the Patent Level 

We derive difference-in-differences estimates of the effect disruptive discoveries have on the use of 
their predecessors using a sample of prior art cited by disruptive academic patents and a matched 
control group of prior art patents cited by inventions with random disruptiveness. The control 
sample was selected using coarsened exact matching (lacus et al., 2011; Singh & Agrawal, 2011). 
Prom the 54,322 university patents we selected all those that (1) were one standard deviation above 
the mean on disruptiveness (among those patents with positive disruptiveness), (2) cited at least 
one piece of prior art, and (3) fell into one of the six technology categories tracked by NBER (Hall 
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et al., 2002). We then collected the prior art citations for the resulting 2,980 patents. Next, the 
prior art-focal patent pairs were matched to a set of control prior art-focal patent pairs using (1) 
the NBER classification of the prior art and focal patent, (2) the grant year of the focal patent, 
(3) the separation between the grant year of the focal patent and its prior art (matched on deciles 
of 0-2, 3, 4, 5, 6, 7, 8, 9-10, 11-12, and 13-|- years), (4) the total number of citations received by 
the focal patent's prior art in the three years before and including its issue (matched on deciles 
of 1, 2, 3, 4, 5, 6-7, 8-10, 11-16, 17-45, and 46-|- citations), and (5) the total number of prior art 
citations made by the focal patent (matched on quintiles of 1, 2, 3, 4, 5, 6-7, 8-10, 11-14, and 15-|- 
citations). A total of 31 focal patents could not be paired with a suitable control, leaving 2,949 
patents. Finally some patents were dropped because they (1) only cited prior art granted before 
1976 (the year in which our annual citation data begins), (2) were granted after 2006 (and thus 
did not have sufficient time to influence citations to their prior art) or (3) they did not cite any 
prior art that fell into one of the NBER technology categories. This step resulted in the loss of 
1,112 patents, for a final analysis sample size of 1,837 disruptive patents. These 1,837 patents were 
then associated with their prior art and matching control patent-prior art pairs; both groups had 
2,746 pairs, for a total of 5,492. The data were converted to panel form in order to record annually 
updated citation counts to the prior art. Each sample had 59,374 focal patent-prior art-years, for 
an effective panel size of 119,486. 

Insert Table 4 about here 

The result of this procedure is a control sample that closely matches our destructive (treatment) 
academic patent-prior art pairs. Table 4 reports descriptive statistics for patents in both groups. 
If disruptiveness validly captures the extent to which an innovation diminishes future uses of tech- 
nologies that preceded it, then we should see a significant decline in citations to the treatment 
group of prior art patents relative to the control. This is exactly what we find. 

Insert Figure 3 about here 

Figure 3 tracks mean citations to our matched samples of treatment and control patents in the 
five years prior and subsequent to the issuance of a disruptive patent. The x-axis is a timeline 
standardized around the year (0) in which focal treatment or control patents were granted. One 
year before 'treatment' (x-axis = -1) the prior art patents in both samples were cited at an almost 
identical rate of 0.78 (treated) and 0.87 (control) citations. Three years later — two years after 
treatment (x-axis = 2) — a gap opens. Citations to control patents (the dashed line) have risen to a 
peak of 1.24 citations while citations to the prior art of disruptive innovations have declined to 0.88, 
on average. Thus, disruptiveness identifies technologies that substantially interrupt subsequent use 
of discoveries on which they built. 

The inset table reports differences across groups of patents and time periods. The first column 
summarizes rates of citation to treatment and control patents in the five-year period before a 
disruptive patent issues. These well-matched samples are cited at a remarkably similar rate, with 
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treated patents receiving only 0.04 fewer citations on average. After a disruptive patent issues, 
however, treated patents are cited on average 0.33 fewer times than control. Citations to both 
samples grew in the later period, but citations to treated patents grew at a rate that was 0.29 lower 
{p < 0.001), a decline of some 60.1% relative to the control 

Thus far, our evaluation of disruptiveness and radicalness has addressed the face validity and 
discriminatory power of our framework relative to more common approaches that rely on indicators 
of impact and distinctiveness. We have demonstrated that (1) disruptiveness is only modestly 
correlated with impact, (2) the discoveries our approach identifies as disrupting or amplifying are 
substantively sensible and fit well with published evaluations of high profile innovations, and (3) the 
prior art cited by disruptive patents exhibits a substantial decline in citations relative to a closely 
matched control group. In other words, the measures appear to validly operationalize the theoretical 
concepts they target and accurately characterize the effects disparate types of discoveries have on 
the use of their predecessors. But, is being able to quantify these theoretically interesting differences 
likely to lead to new substantive findings? Put simply, are these new measures useful research tools? 
We address this question using disruptiveness and radicalness as dependent variables in models that 
explore several competing arguments about the factors that contribute to universities' ability to 
generate important patents. 
4.3 Research on Academic Patenting 

In 1980, Congress passed the Bayh-Dole Act; a law that allows organizations that perform federally 
funded research to file for patents and issue licenses on intellectual property (IP) they develop. The 
act accelerated a trend toward research commercialization on campus. Over the last thirty years, 
academic patenting has increased dramatically. Some inventions have been highly lucrative for the 
institutions that own them by generating new products, companies, and even industries. 

Proponents of Bayh-Dole call it 'prescient' (Cole, 1993) and herald the act's importance in 
turning university science into an engine of economic development (Powell et al., 2007). In 2002, 
The Economist (2002: 3) called the act "possibly the most inspired piece of legislation enacted in 
America over the past half century" and went on to attribute it an important role in "reversing 
America's precipitous slide into industrial irrelevance." By the same token, critics of Bayh-Dole and 
commercialization bemoan the 'selling' of the university (Greenberg, 2007), link the act to the 'cor- 
porate corruption' of academe (Washburn, 2005), and argue that proprietary research diminishes 
universities' scientific and public mission (Krimsky, 2004). 

Hyperbole aside, both the economic benefits and the dangers of academic commercialization 
are often attributed to the type of inventions that universities produce. For those with rosier 
views, it is precisely the university's capability to generate unexpected, market-creating inventions 
outside the channels of corporate R&D that make academic innovations valuable. In the terms 
we use here, the economic benefits of Bayh-Dole rely in part on academic scientist's propensity 
to generate radically disrupting inventions. Although critics approach Bayh-Dole from a range of 
philosophical starting points, one thread running through most negative appraisals is concern that 

^"For details on significance tests for tlie difTerence-in-differences estimation, see Figure 3. 
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attention to the commercial value of academic ideas leads to capture by corporate interests, and 
with it to university science closely wedded to industry priorities. Put differently, one significant 
concern about Bayh-Dole suggests that as research commercialization becomes more widespread, 
both published and patented science will tend to amplify the status quo. 

This tension has led many academic analysts to assess the costs and benefits of university 
research commercialization (Trajtenberg et al., 1997; Henderson et al., 1998; Mowery et al., 2002). 
Two key themes in this line of work emphasize (1) the value of academic innovations, and (2) the 
relationship between increases in the use of proprietary science and the vitality of more fundamental 
research and training. 

Scholars pursuing the former question express concern over the relationship between the sources 
and types of R&D funding that support academic research and the volume or impact of patented 
science on campus. Although the results of some studies conflict, most find evidence that increases 
in the quantity of academic patenting do not decrease its impact at the campus level (Mowery et 
al., 2002). These studies also suggest that connections with industry help academic institutions 
learn to patent up to a point. Owen-Smith and Powell (2003) find a curvilinear (inverted-U shaped) 
relationship between ties to biotechnology firms and the impact of a university's patent portfolio. 
They attribute diminishing returns to the likelihood of corporate capture of technology transfer 
priorities. 

The relationship between academic (papers) and proprietary (patents) research outputs has also 
been much examined. Owen-Smith (2003) demonstrates that patent flows are deeply intertwined 
with traditionally academic inputs and outputs such as federal grants and publications. Sine et 
al. (2003) find that academic visibility in the form of article citations has increases the likelihood 
patents will be licensed by industry. For a set of life science patents issued to 89 university campuses, 
Owen-Smith and Powell (2003) find a positive relationship between the citation impact of life science 
papers and the overall impact of a university's patent portfolio. 

Technology Transfer Experience. Prior work reports mixed results about the effects of 
experience with patenting. More experience in the form of increasing patenting may be associated 
with declines in impact, as universities looking to develop strong patent portfolios pursue more 
incremental innovations (Henderson et al., 1998). An alternative proxy for experience, the age of 
a university's technology transfer office, suggests different relationships. Most technology transfer 
units function at an economic loss, yet many are under intense pressure to generate revenue (Kenney 
& Patton, 2009). The result is often that the youngest and most tenuous offices are more likely to 
pursue quick and relatively sure innovations that are modestly amplifying and thus easily marketed 
to potential industrial licensors, rather than more difficult to evaluate disruptive inventions that 
might be harder to sell and slower to realize economic returns. In sum, the literature leads us to 
expect that increasing experience with technology transfer will also increase the impact of university 
patent portfolios, but that same experience might plausibly lead campuses to produce either more 
amplifying or more disruptive patents. 

Research Support. Owen-Smith &; Powell's (2003) observation that greater corporate engage- 
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ment leads to the capture of university technology transfer efforts suggests that science supported 
by industrial partners is likely to generate innovations that increase the use of existing technolo- 
gies. We thus propose that industry support of university R&D will lead universities to pursue 
more amplifying discoveries. Likewise, levels of support from the NSF and NTH, the nation's pre- 
mier funders of basic science, should yield research that is less connected to existing industrial 
needs. Thus, more federal grants and more patents derived from them should be associated with 
the generation of more disruptive innovations. 

Broadly speaking, if the decentralized peer-reviewed process by which federal science agencies 
apportion R&D support are more likely to fund research focused on academic concerns divorced 
from the needs of industry, then campuses that perform more federally funded research and those 
whose patents emerge from federally funded projects should produce more radically disruptive 
patents. Likewise, because corporate R&D funding is presumably linked to sponsors' proximate, 
market-driven goals, we expect campuses that pursue more industrially funded R&D to produce 
patents that amplify the use of existing technologies. While any source of external support seems 
likely to yield higher impact patents, we hypothesize that industrial connections will be associated 
with amplifying innovations, while public sector funding will lead to more disruptive discoveries. 

Scientific Capacity. Although existing measures of publication impact suffer from many of 
the same limitations as the patent citation measures wc critique above, we use them to provide some 
sense of the relationship between high-impact public and important proprietary science. We follow 
two lines of reasoning in our analysis. Noting first with Sine and colleagues (2003) that articles con- 
fer a 'halo effect' on associated academic patents while advertising their value to potential licensees, 
we expect both the volume and impact of academic science to be associated with higher-impact 
patent portfolios. To the extent that highly-cited papers generate scientific attention because they 
report novel, basic-science discoveries that are far removed from the current concerns of indus- 
try, we would expect higher-impact publications to be associated with more radically disruptive 
innovations. 

4.4 Model Estimation and Results 

We first model patent volume as a simple yearly count of issued patents by application date. To 
capture time-invariant heterogeneity among universities and to account for overdispersion, we use 
a conditional fixed effects negative binomial specification (Hausman et al., 1984). We next consider 
the impact of academic patent portfolios using a count of forward citations. Because most patents 
require several years to accumulate the bulk of their citations, we count citations from the year of 
application — with the earliest being applied for in 1981 — to 2010. This means that patents applied 
for at the end of our panel in 2005 have a full five years to accumulate citations, which should 
attenuate right censoring bias resulting from citation lags (Hall et al., 2002). Here too we mobilize 
a fixed effects negative binomial specification. 

Our next dependent variables operationalize the idea of distinctiveness using Trajtenberg and 
colleagues (1997) index of originality and Fleming's (2001) measure of technology area combi- 
nations. Both constructs emphasize the extent to which new innovations reach across existing 
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technology categories at the time of their appHcation. The former is a Herfindahl measure of the 
primary classes of the patents a focal patent cites; the latter is an indicator variable that takes on 
a value of 1 if a focal patent bridges a previously uncombined set of secondary technology classes 
and otherwise. Finally, we estimate models of disruptiveness and radicalness, which are both 
calculated using citations received between the application year and 2010 so that the measures par- 
allel our impact variable. We aggregate these measures to the portfolio level by averaging across 
all patents applied for by each university at time t + 1. Because all of these last four variables are 
continuous, we adopt an OLS specification that includes year and university fixed effects. 

Our independent variables correspond to the sets of explanations outlined above. Table 5 
displays the coefficient estimates for each dependent variable We discuss our findings from Table 
5 row-by-row to emphasize the disparate effects of the same independent variables on different 
outcome measures. 

Insert Table 5 about here 

Technology Transfer Experience. The first four rows of Table 5 report the effects of vari- 
ables that index a campus's experience with technology transfer. Patent stock reflects a university's 
aggregate experience. Increased patenting experience is associated with greater yearly patent flows 
(Model 1) but not with increased impact (Model 2), distinctiveness (Models 3 and 4) or disruptive- 
ness (Model 5). Model 6 documents a strong negative relationship between patenting experience 
and radicalness. As universities succeed in their pursuit of more IP, their patents tend to amplify 
existing technological arrangements. 

The age of a university's technology transfer office and its quadratic term also demonstrate 
that the relationship between experience and patent quality is more nuanced than suggested by 
previous studies. Age has an inverted U-shaped relationship with both patent impact (Model 2) 
and radicalness (Model 6); however, there is a negative and linear relationship between this measure 
of experience and disruptiveness (Model 5). The relative size of first and second order coefficients 
in Models 2 and 6 suggest that there are diminishing returns to experience rather than a reversal 
of effects. 

The strong negative coefficient reported in Model 5 implies that experienced offices pursue 
patents on more amplifying innovations. This may stem from several mechanisms. First, established 
technology transfer offices might pursue repeated licenses with the same corporate partners, or use 
a small number of well-known partners to help vet disclosures (Owen-Smith, 2005). Either activity 
could closely link a university's patent portfolio to partners' proprietary concerns, resulting in more 
amplifying IP. Alternatively, established offices may strategically pursue patents on suites of related 
technologies or because of the important role that long term relationships with a small number of 
prolific inventors tend to play in academic technology transfer (Colyvas, 2007). Either dynamic 
would result in more amplifying patents, as universities work to protect families of innovations built 
from interdependent IP. 

^^Tables with nested model specifications for each variable are available upon request. 
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Scientific Capacity. We use the log of scientific articles published in the preceding year to 
index the volume of academic research on campus. In addition, we include a year and subject area 
standardized measure of the citation impact factor of those articles as a proxy of the visibility and 
quality of a campus's published research. Both measures are drawn from the Institute for Scientific 
Information's (ISI) University Indicators Database. 

Model 2 shows positive and significant effects of impact factor and quantity of scientific articles 
on overall patent impact. Thus, consistent with prior research, the quality and quantity of an 
institution's science signals value to industrial interests. Models 5 and 6 show significant, positive 
effects of impact factor on patent disruptiveness and radicalness, respectively, which suggests that 
institutions with higher quality science tend to produce more disruptive patents. We do not find a 
significant association between the quantity of scientific articles and radicalness. Taken together, 
these findings provide noteworthy support for the idea that highly visible academic research yields 
both higher impact and more disruptive patents. 

Research Support. Industry-sponsored R&D measures the dollar value, in millions, of grants 
and contracts from corporations to researchers on campus. This variable comes from NSF surveys 



of campus level R&D efforts available from the online WebCaspar database Our second measure, 
industry contractual ties, emphasizes formal relationships with firms in technology intensive indus- 
tries. Information on financial, R&D and licensing connections were content coded from Securities 
and Exchange Commission filings made by a sample of 634 publicly traded firms in high-technology 
sectors (c.f. Buhr & Owen-Smith 2010). The results reported in Model 2 (impact) and Model 6 
(radicalness) are particularly interesting. Higher levels of industrial R&D support lead to increases 
in the impact of university patent portfolios while decreasing their radicalness, a pair of findings 
consonant with the idea that corporate partners support high quality research that is related to 
an existing technology base. Industrial R&D support may thus have the effect of more tightly 
linking the expertise and concerns of academic researchers with corporate funders, resulting in 
patents that strengthen the position of incumbent firms. Having more contractual ties to corporate 
partners likewise diminishes the radicalness of university innovations (Model 6), but that finding 
may result from the fact that universities that are more closely connected to industry also generate 
lower-impact patent portfolios. Neither measure of industry connection has a significant effect on 
disruptiveness. 

Finally, we consider how federal funding for science and engineering helps shape the importance 
of academic patents. We track the level of support (in millions of dollars) that flows to campuses 
from the two premier federal science agencies, the NSF and the NIH. Additionally, we measure the 
number of patents in a university's portfolio that include an acknowledgement of 'government inter- 
est.' Patents that emerge directly from federally funded research projects must allow the state to 
claim certain ownership rights as a result of that funding. Thus, universities with a greater number 
of government interest patents have patent portfolios that are more closely linked to federally funded 
R&D activities. Federal grant measures were extracted from the NSF's WebCaspar database, while 



https : / /webcaspar . nsf . gov/ 
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information on government interest was taken from full text patent documents. Neither NIH nor 
NSF funding by itself is related to the impact of university patent portfolios, whereas increases in 
both lead campuses to patent more radically disruptive innovations. Government interest patents, 

by contrast, arc positively associated with both impact and radicalness. 

The different effects of industrial and federal R&D support in these models are stark. More in- 
dustry connections are associated with the production of more amplifying patents. Federal support 
yields more disruptive IP. Both are associated with higher impact. Thus, impact is an ambiguous 
construct that does not take into account the key substantive differences between inventions whose 
value derives from bolstering the status quo and those that are important because they challenge 
it. 

Our analyses hold lessons for both defenders and detractors of Bayh-Dole. For the former, the 
story is clear: the sometimes-spectacular wave of university inventions (including those we highlight 
in Table 2) depends on the foundation of academically important, publicly funded science. Thus, 
to preserve their economic contributions, the academic character of university science should be 
encouraged. For the latter, it is apparent that tighter industrial connections yield patents that 
reinforce existing technical arrangements; a finding that should deepen concerns about the long- 
term effects of commercialization on universities, their research, and ultimately their economic 
contributions. 

5 DISCUSSION 

The dynamic network approach and accompanying measures of innovation disruptivcness and rad- 
icalness we propose capture theoretically important, but thus far underutilized, information about 
the evolution of networks of related inventions. Those structural, dynamic, continuous, and va- 
lenced measures discriminate among the highest impact patents, identify some of the most high 
profile disruptive and amplifying inventions of the last three decades, and suggest many new av- 
enues of research in a variety of fields. When applied to substantive questions about the costs and 
benefits of university research commercialization, the package of theoretical and empirical tools 
presented here yields starkly different results on some dimensions, while replicating current knowl- 
edge on others. Both sorts of findings have important implications for ongoing academic and policy 
debates. 

We began by noting that although canonical theories of innovation and technological change 
emphasize the effects that new discoveries exert on the value and utility of their predecessors, 
available measures do little to address these dynamics. These measurement shortcomings can lead 
to empirical findings that arc ambiguous and contradictory, limiting social scientists' ability to 
develop and refine theories of innovation. 

Disruptiveness does an effective job of distinguishing among important innovations. Among 
the 0.25% most cited patents, the measure is roughly normally distributed and nearly uncorrelated 
with relative differences in impact (r = 0.05, p < 0.001). Our measure also holds up well to 
descriptive tests of face validity in both aggregate terms and as pertains to individual, high profile 
discoveries. In short, disruptiveness appears to be capable of distinguishing the right kinds of 
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innovations from each other on both quahtative and quantitative dimensions. Disruptive patents 
cause a dramatic dechne in citations to their prior art. The measure is orthogonal to impact and 
captures precisely the empirical effect that is its target. Finally, radicalness yields clearer findings 
about the institutional and organizational sources of academic patents than do more standard 
measures. These findings suggest novel implications for the study of innovation in this important 
realm. 

Below, wc briefly address implications of our perspective for a variety of substantive areas where 
it is likely to be particularly useful. 

Implications for Science Policy. In recent years, efforts to develop evidence-based science 
policy measures have triggered extensive work in what has come to be called the science of sci- 
ence policy (Lane, 2010; Fealing et al., 2011). Among other concerns in this burgeoning field is 
the question of how to support, identify, and evaluate transformative research. We submit that 
variants of the measures we propose might aid in efforts to rigorously document the transformative 
effects of different collaborative or funding models by, for instance, associating differing levels of 
intcrdisciplinarity or scientific team structure with the production of more or less radical findings 
that enhance or replace existing knowledge bases. 

Implications for Research on Social Networks and Innovation. The dynamic network 
approach wc propose here may also help generate new insights in research on social networks and 
innovation (Hansen, 1999; Burt, 2004; Obstfcld, 2005). A persistent challenge in this area has 
been to distinguish between the effects of more open, unconstrained social networks and more 
closed or cohesive structures. Current findings suggest that the former are more effective for 
generating new ideas while the latter are more suited to the oftentimes-difficult work of development. 
The distinction between discovery and implementation, though, may mask a more fundamental 
difference between network positions that facilitate novel but disruptive innovations and those that 
support more amplifying discoveries. 

Perhaps more significantly, the commonplace distinction between cohesive networks and more 
open structures may be insufficient for explaining the different effects of similarly good ideas. 
Search through cohesive ties, for instance, might yield amplifying discoveries, while brokerage in 
open networks may be associated with innovations that have the potential to disrupt the status 
quo of the context from which they spring. The dynamic network framework wc propose may 
also be useful for identifying when brokers are bridging groups engaged in different, though jointly 
amplifying, lines of work, and when the technological streams they seek to develop are at odds or 
simply orthogonal to one another. 

Implications for Economic Geography. This approach could also be of use in work on 
the causes and consequences of regional industrial agglomeration in high technology industries. 
Competition is stiffer within clusters than outside them (Stuart k, Sorenson, 2003). Recent work 
has documented the different roles that physical proximity to universities and other firms and geo- 
graphically local versus distant tics play in the innovative performance of biotechnology companies 
(Owen-Smith k, Powell, 2004; Whittington et al., 2009). Both lines of work suggest that loca- 
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tion in vibrant regions forces firms to compete more vigorously, but research in this area has not 
attempted to distinguish among the types of discoveries made by geographically clustered and geo- 
graphically isolated organizations. To the extent that such clusters constitute centers of gravity for 
many high technology industries, their implications for the amplifying or disruptive characteristics 
of discoveries would be of interest to scholars, managers, and policymakers. 

Implications for Studies of Technological Change. Measures of radicalness and dis- 
ruptiveness will also prove useful in efforts to understand the maturation and disappearance of 
technological standards (Nelson &: Winter, 1982; Dosi, 1988; Klepper, 1997). Recall our brief dis- 
cussion of two related technologies — the Scanning Electronic Microscope (SEM) and Atomic Force 
Microscope (AFM) — identified in Table 2. In our view, the SEM is a greater breakthrough innova- 
tion because it was more disruptive. The AFM, in contrast, was only moderately disruptive because 
it built on and expanded the technological base created by the SEM. Yet, the less disruptive AFM 
has proven to be more important to the development of nanotechnology. This dynamic suggests 
interesting possibilities for studying the evolution of new technology areas such as nanoscale mate- 
rials (Darby & Zucker, 2003) or tissue engineering (Murray, 2002). In both these arenas, wc might 
expect early innovations to disrupt incumbent's capabilities, but as the technologies (and related 
organizations, networks, and markets) mature we might also find later discoveries shifting toward 
the amplifying end of the spectrum. Studies of punctuated technological and scientific change may 
benefit from such analyses if disruptive innovations are followed by successively more amplifying 
discoveries that build on and extend their reach. More mature fields dominated by less destructive, 
more incremental innovation may also be ripe for radical discoveries that will spark another cycle 
of technological development. 

Implications for Research on Corporate Strategy. The ability to distinguish between 
discoveries that amplify and those that erode the use of existing technologies may also be valuable 
for examining a range of questions in corporate strategy research. For instance, consider debates 
over the effect of market power on incentives to innovate. Much like research on university patenting, 
this literature has produced conflicting theoretical arguments and empirical findings (Gilbert, 2006; 
Ahuja et al., 2008). Although some scholars contend that incumbents should pursue innovation in 
order to maintain their positions (Schumpeter, 1942; Christensen, 1997), others argue the opposite 
and claim that incentives are depressed due to lack of competition (Arrow, 1962). Ahuja and 
colleagues (2008: 8) note that empirical efforts to resolve this debate have been challenging, "since 
the main effects are countervailing." To the extent that firms may differ with respect to the 
amplifying or disruptive aims of their R&D efforts, the framework we propose here could help to 
disentangle some of these countervailing effects. 

Implications Beyond Innovation Research. Finally, consider some uses of a dynamic 
network approach to innovation far afield from the world of technological change. Our disruptiveness 
and radicalness measures might profitably be adapted to studies of the evolving link structure of the 
World Wide Web, where new pages will cite and be cited by others. Similarly the evolving structure 
of citations among judicial decisions that comprise an important aspect of U.S. law might profitably 
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be examined in these terms. Rather than measuring importance ultimately in terms of competency 
destruction or enhancement, these measures might offer new insight into more political and cultural 
questions involving the dynamics of polarization in the blogosphere (Adamic & Glance, 2005), the 
evolution of management fads and fashions (Strang & Macy, 2001), the visibility of music artists 
and genres (Rossman et al., 2008), the commercial and critical impact of films, and the larger legal 
implications of new court decisions. Evolving network data that offer insights into relationships of 
deference among entrants and incumbents in a variety of substantive domains are becoming more 
readily available and are important to research questions in many disciplines. In this context, the 
dynamic network approach we propose has the potential to serve countless useful purposes. 

6 CONCLUSION 

Wc began this article with a foundational quote from Schumpctcr. That insight served as a stepping 
stone for nearly two generations of research that took the notion of innovation-based creative 
destruction as a motor for economic, technological, organizational, and social transformation. While 
Schumpeter and many others have noted that what makes a given invention important is the 
extent to which it is used, the question of how, precisely, such uses strengthen or challenge the 
status quo has remained elusive. This article outlines a dynamic network approach to the study of 
breakthrough innovations that foregrounds the effect new discoveries have on the uses to which their 
successors put the technologies upon which they depended. In so doing, we more fully operationalizc 
a key but as yet under-examined component of most theories of innovation: the fundamental 
distinction between innovations that are valuable because they are disruptive of current standards 
and those whose value derives from the amplification of the trajectories from which they spring. 
While not without limitations, wc believe this approach and the measures we present and validate 
have substantial, exciting possibilities to expand research in multiple fields. 

7 APPENDIX 

For the purposes of presentation, we simplified the disruptiveness index in several ways. Specifically, 
the variant of the measure used in the text is limited in that it (a) assumes that there is only one 
one node in the focal class (i.e., one focal patent), and (b) for each node in a given class, collapses 
what may be multiple cross class ties into a single 0, 1 indicator. In this appendix, we present a 
more general version of the measure that removes these simplifications. 

Consider a tripartite graph G = (Vi, V2, V3, £^). Let Vi, V2, and V3 represent three classes of 
nodes and E denotes the edges in G. Nodes can only be connected if they are members of different 
classes. For illustrative purposes, let Vi represent a set of q pieces of prior art, V2 represent a set of 
m focal patents, and V3 represent a set of n forward citations. To capture the pattern of citation 
between classes of vertices, we define two incidence matrices, F and B, which record links between 
the forward citations (V3) and the focal class (V2) and the forward citations (V3) and the prior art 
(Fi), respectively, such that 



fij 



1 




if vertex n of class V3 cites vertex m of class V2 
otherwise. 



(5) 
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and 



1 if vertex n of class V3 cites vertex q of class Vq 
otherwise. 



(6) 



The incidence matrices can be thought of as analogues to adjacency matrices for multipartite 
graphs. Here, the rows of both F and B correspond to the elements of V3 (forward citations). The 
columns of F are the elements of V2 (focal patents), while the columns of B arc the elements of 
Vi (prior art). Using the information stored in the incidence matrices, we can now define a more 
complete version of the measure as 



D' 



E 



S fij 



m 



J 



k=l 



V 



+ 



/ m 
S fij 



J 



m 



\ 



J 



(7) 



Dividing each sum by the total number of focal patents (m) or pieces of prior art {q) available 
for citing effectively normalizes the measure so that it ranges from -1 to 1. A corresponding version 
of radicalness can be obtained by eliminating the normalization and introducing a vector of weights 
w = {wi,W2, . . . , Wn-i,Wn) such that 



fe=l 




, Wi > 0. 



(8) 



The ability to expand the size of class V2 (focal patents) may be useful in a variety of extensions, 
particularly for research on patent pools or corporate intellectual property portfolios. This variant 
of the measure is also attractive in that it retains some structural data that is lost through the 
collapsing of multiple tics into a single indicator as described above. However, it is important to 
note that this approach gains nuance at the expense of added complexity. To continue with the 
example of patents, in order for a set of patents (V2) to be maximally amplifying on this metric, all 
forward citations would need to cite all members of focal class and all prior art cited by that class. 
Similarly, maximal disruptiveness would only be achieved if all forward citations cited all members 
of the focal class and no prior art. We may, as a result, expect the values of the measure to cluster 
more closely around as the size of V2 grows larger. Additional complications arise from the fact 
that, at least in the patent context, members of the focal class may cite on another. If course, this 
is only a problem if V2 has more than one element. 
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Fig. 2. — Network diagrams for the Monsanto, PageRank, and Axel patents. The focal patent is a black 
diamond; its prior art is indicated by white diamonds. Triangles cite the prior art but not the focal patent, 
squares cite the focal patent and its prior art, and circles cite the focal patent but not the prior art. The 
degree centralities of the focal patent prior art are given in parentheses. Node sizes of the focal patent and 
prior art are proportional to the degree centralities. Disruptiveness over time is shown below each network. 
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Tabic 4 



Descriptive Statistics for Groups 
Used in Difference-In-Differences (DID) Estimation 
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Notes. — Each group consists of 2,746 patent -prior art pairs, for for an effective sample size of size 
of 5,492. Disruptive patents are defined here to be those that are one standard deviation above 
the mean level of disruptiveness among the sample of university patents, conditional on having a 
positive disruptiveness score and citing at least one piece of prior art. 
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